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The  Final  Report  for  Virtual  Environment  for  Surgical  Room  of  the  Future 
(aka  Virtual  Prototyping  of  the  Future) 


Introduction: 

Rapid  technological  innovation  in  the  last  decade  has  provided  society  with  a 
glimpse  of  the  profound  importance  that  these  technologies  will  have  on  the 
future  of  our  habitable  environment.  One  group  that  vividly  recognizes  this 
advancement  --  a  collaborative  team  of  scientists,  designers,  and  engineers, 
and  surgeons  from  Harvard  University,  the  Massachusetts  Institute  of 
Technology,  and  the  Massachusetts  General  Hospital  --  have  begun  to  explore 
to  the  dimensions  this  technology  in  the  design  and  development  of  a 
surgical  room.  The  goal  of  the  project  was  to  create  a  unique  multimodal 
virtual  design  environment  that  can  be  used  to  reconceptualize  current 
surgical  environments  and  to  anticipate  changes  in  these  environments 
necessitated  by  ongoing  technological  progress  in  surgical  treatment  and 
training.  The  project  will  serve  the  dual  needs  of  both  civilian  and  military 
health  care  by  developing  a  design  for  an  operating  room  of  the  future,  as 
conceived  within  the  context  of  an  adaptive  vision  of  the  hospital  of  the 
future.  Innovative  new  medical  technologies  currently  being  developed  to 
meet  military  needs  will  be  incorporated  in  these  designs.  Ultimately,  a 
prototype  of  a  new  surgical  room  design  is  proposed  to  be  placed  at  the 
Massachusetts  General  Hospital  (MGH)  for  demonstration,  testing,  and 
evaluation. 

The  Problem 

Surgical  procedures  of  great  complexity  are  currently  performed  in  operating 
environments  that  have  not  changed  substantially  in  many  years  except  for 
constant  retrofitting  to  accommodate  ever-changing  medical  technologies. 

These  actual  and  anticipated  advances  in  modem  surgical  treatment  methods 
have  long  outpaced  developments  in  the  architectural  design  of  the 
environments  which  house  them.  Not  only  are  these  operating 
environments  incapable  of  adapting  to  changing  surgical  needs,  but  their 
intrinsic  architectural  qualities  are  also  insufficient.  One  MGH  surgeon 


3 


defines  the  contemporary  operating  room  as  "a  fairly  sterile  cold  box  in  which 
medical  equipment  is  positioned  around  the  patient  and  medical 
practitioners...there  is  a  lack  of  space...multiple  cables  prevent  free  circulation 
of  personnel  within  the  room  creating  hazards  both  electrical  and 
physical.,.and  communication  is  difficult". 

There  is  an  urgent  need  for  improvements  in  operating  room  facilities. 
Equally  important,  however,  are  issues  surrounding  the  role  and  functioning 
of  an  operating  room  within  the  context  of  a  hospital  and  even  larger  medical 
care  contexts.  Current  developments  in  information  technology, 
telemedicine,  remote  surgery  devices,  and  other  developments  are  already 
beginning  to  pose  a  challenge  to  the  very  nature  of  current  attitudes  towards 
what  a  hospital  should  be  —  with  consequent  challenges  towards  associated 
physical  designs  for  hospital  facilities.  Rapid  and  accurate  assessment  of 
design  changes  within  this  process  of  redefinition  is  one  of  the  primary 
functions  of  design  within  a  virtual  environment. 

Many  of  these  innovative  technologies  are  being  developed  through 
sponsorship  of  the  Advanced  Biomedical  Technology  Program  to  serve 
military  needs.  There  is  great  potential  dual-use  value  to  many  of  these 
technologies.  The  proposed  LSTAT  unit,  for  example,  can  easily  be 
envisioned  as  meeting  both  military  and  civilian  needs;  the  MEDFAST 
vehicle  could  also  potentially  be  applied  to  both  situations.  These  same 
technologies  could  provide  a  much-needed  stimulus  for  further 
developments  in  the  civilian  health  care  domain. 

A  fundamental  difficulty  in  responding  to  the  need  for  improved  operating 
rooms  and  reconceived  hospitals  is  the  lack  of  powerful  capabilities  for 
designing  these  sophisticated  environments.  Architectural  firms,  even  those 
involved  in  hospital  design,  still  use  traditional  CAD  design  and  drafting 
tools  of  limited  value.  It  is,  therefore,  not  surprising  that  current  architectural 
involvement  rarely  goes  beyond  providing  a  shell  into  which  equipment  and 
devices  are  placed. 
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Project  Description;  Three  Phases 


The  project  proposed  herein  is  for  the  first  phase  of  a  multiyear  project.  The 
first  phase  undertakes  the  basic  research  and  definition  of  performance 
requirements  that  are  needed  in  order  to  implement  the  overall  project 
vision.  Subsequent  phases  will  both  enhance  and  ultimately  implement  the 
vision. 

Initially,  design  requirements  will  be  developed  for  an  innovative  virtual 
environment  that  supports  the  creative  act  of  design  in  its  many 
dimensions.  The  goal  is  to  provide  a  new  technological  environment  for 
realizing  the  act  of  design  which  may  ultimately  help  create  a  new  paradigm 
for  architectural  practice.  This  project  will,  using  the  design  of  an  advanced 
operating  room  as  a  working  model,  demonstrate  design  capabilities  within 
this  environment. 

The  immersive  design  environment  envisioned  will  be  multimodal  and 
thus  provide  design  capabilities  that  go  far  beyond  those  possessed  by 
traditional  architectural  design  firms  involved  in  surgical  room  and/or 
hospital  design.  The  virtual  environment  envisioned  will  immerse  both 
designers  and  users  within  the  design  world  to  be  created  during  the  actual 
design  process.  The  Virtual  environment  will  include  not  only  capabilities 
for  modeling  the  visual  world,  but  will  also  include  audio  and  haptic 
interfaces,  as  well  as  their  subsequent  implementations.  Rather  than  simply 
sitting  in  front  of  a  computer  screen  as  is  current  practice,  the  designer  will 
actually  be  immersed  in  the  design  world  in  a  multisensory  way  during  the 
creative  act  itself;  this  unique  design  environment  will  be  used  to  create  a 
surgical  room  of  the  future. 

Users  in  the  immersed  environment  will  be  able  to  evaluate  elements  such 
as  equipment  placement,  lighting,  and  acoustic  environments  which  affect 
the  quality  and  functionality  of  the  space  from  individual  perspectives.  A 
certain  uniqueness  will  arise  from  the  intersection  of  architecture  and  the 
world  of  virtual  environments:  namely,  a  combination  of  experience  with 
design,  human  factors,  environmental  systems,  structures,  and  materials 
with  the  full  potential  of  the  world  of  virtual  environment  technology. 
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PHASE  I 

Development  of  the  virtual  design  environment.  A  preliminary  design  for 
an  operating  room  will  be  prepared  to  serve  as  an  applications 
demonstration. 

PHASE  II 

Design  of  a  surgical  room,  incorporating  further  development  of  the  Virtual 
environment  . 

PHASE  III 

Development  of  a  room  prototype  at  the  Massachusetts  General  Hospital  for 
demonstration,  testing,  and  evaluation.  The  room  will  be  capable  of 
incorporating  new  developments  in  medical  technology,  as  well  as  adapting 
to  technologies  of  the  future.  The  room  will  be  wireless  and  will  incorporate 
advanced  system  integration  concepts.  The  full  potential  of  smart  materials 
and  other  innovative  technologies  will  be  explored. 


Virtual  Design  Environments 

The  ultimate  vision  proposed  herein  of  the  Virtual  Design  Environment 
(VDE)  is  that  of  a  design  environment  that  reflects  an  ideal  view  of 
architecture  and  related  design  activities  as  endeavors  that  fully  integrate  all 
aspects  of  a  human's  experience  within  his  or  her  environment.  All 
interactions  that  occur  within  this  environment  as  a  design  world  are 
considered  susceptible  to  improvement  through  creative  design  acts.  This 
view  necessarily  demands  that  the  Virtual  Design  Environment  be  a 
multimodal  system.  It  must  go  beyond  the  current  practically  exclusive 
preoccupation  with  the  visual  world  of  most  virtual  reality  systems  to 
include  full  auditory  and  haptic  capabilities  with  associated  interfaces. 
Achieving  this  end  will  be  a  truly  innovative  development  and  contribution 
to  virtual  environment  technology. 
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This  vision  of  an  encompassing  architecture  demands  that  the  architectural 
approach  to  be  adopted  in  using  Virtual  Design  Environment  technologies 
must  supersede  conventional  practice  in  its  definition  of  what  constitutes  the 
designed  environment  (traditionally  limited  to  the  room  shell  and  basic 
environmental  systems).  In  the  proposed  approach,  the  designed 
environment  is  conceived  of  as  a  complete  and  integrated  continuum  that 
includes  not  only  larger  hospital  and  room  environments,  but  considers  the 
immediate  surgical  setting  (including  devices  such  as  telesurgery  systems, 
anesthesiology  workstations,  the  surgical  table,  etc.)  as  a  critical  part  of  the 
room  architecture.  This  approach  is  founded  on  the  obvious  and  reasonable 
premise  that  room  qualities  necessarily  affect  the  design  and  placement  of 
devices  within  the  surgical  setting  and  vice  versa. 

Ultimately,  this  vision  suggests  that  the  designed  world  of  the  operating 
room  encompass  a  continuum  from  the  environment  of  the  room  through 
medical  treatment  devices,  and  down  to  the  level  of  the  surgeon's  visual, 
auditory,  and  haptic  experience  of  the  organ.  This  integration  is  the  ultimate 
goal  underlying  the  specific  kind  of  Virtual  Design  Environment  (VDE) 
technology  herein  proposed.  On  a  practical  level,  it  can  be  perhaps  argued 
that  the  linkage  to  organ  models  and  surgical  simulations  is  not  directly 
necessary  to  achieve  good  designs  of  the  room  and  immediate  surgical 
environment,  but  developing  a  capability  for  design  and  user  interactions  at 
any  point  along  this  continuum  will  give  the  Virtual  Design  Environment  a 
power  and  usefulness  that  simply  transcends  debates  of  this  type.  Conceiving 
of  the  design  problem  in  this  way  also  ultimately  allows  the  virtual  models 
created  as  part  of  the  architectural  design  to  be  useful  for  other  purposes.  For 
example,  by  designing  the  Virtual  Design  Environment  so  that  it  has 
capabilities  for  effectively  interfacing  with  any  of  several  good  surgical 
simulation  systems,  or  even  having  a  surgical  simulation  system  as  part  of 
the  virtual  environment  created,  a  training  system  of  unparalleled  value 
could  be  created  in  which  surgeons  in  training  could  operate  on  virtual 
organs  via  virtual  surgery  devices  —  all  within  a  virtual  operating  room. 

The  vision  of  the  Virtual  Design  Environment  as  a  multimodal  system  that 
can  support  design  and  user  interactions  at  any  point  along  a  continuum  of 
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changing  relevant  environments  (room,  devices,  body)  can  usefully  be 
brought  to  an  even  higher  level  of  interest.  Designers  now  cannot  actually 
enter  the  world  that  they  are  designing  except  through  their  imaginations. 
The  traditional  design  tools  of  drawings  or  models  --  even  sophisticated 
rendered  and  animated  models  in  a  computer-aided  design  environment  ~ 
still  necessarily  place  the  designer  (and  certainly  the  user-client)  outside  of 
the  design  world  as  an  observer  looking  into  it.  Literally,  the  designer  is 
usually  looking  at  a  computer  screen,  drawing,  or  model.  The  vision  of  the 
Virtual  Design  Environment  proposed  herein  is  that  the  architect  or  designer 
would  enter  into  the  design  world  being  created  during  the  actual  act  of 
creation  --  all  through  virtual  environment  technologies.  The  design  world 
would  be  created  while  the  designer  is  immersed  within  it.  This  concept  has 
the  potential  for  forever  altering  paradigms  about  how  design  occurs. 

Ultimately,  the  Virtual  Design  Environment  (VDE)  will  be  developed  to 
support  many  of  the  implementation  issues  described  in  Section  Four  (e.g., 
structural  analysis  and  design,  design  for  manufacturing  and  assembly,  parts 
inventory,  etc.). 

Preliminary  Surgical  Room  Design  (See  Appendix  4) 

A  preliminary  design  for  an  operating  room  of  the  future  would  be 
developed  as  part  of  first  phase  activities  as  a  demonstration  of  the  capabilities 
of  the  Virtual  Design  Environment. 

Immediate  architectural  goals  of  the  project  are  threefold: 

1.  Improvement  of  the  human  factors  environment  for  medical  personnel 
and  patients  by  reducing  the  hostile  interface  between  patients,  health  care 
providers,  and  surgical  spaces. 

2.  Improvement  of  surgical  efficiency  by  simplifying  complex  technical 
barriers  that  exist  between  surgeons,  medical  equipment,  supporting 
information,  and  control  systems. 

3.  Improvement  in  room  environments  and  components  designed  to 
facilitate  procedural  efficiency. 
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The  project's  architectural  design  activities  will  be  pursued  at  several  levels: 


1.  At  the  level  of  the  immediate  surgical  environment,  all  critical 
components  will  be  modeled,  including  telesurgery  devices  which  will  be 
operable  in  real  time.  As  discussed  in  Section  1  (Innovative  Claims), 
telesurgery  and  other  devices  are  considered  in  this  architectural  design 
approach  as  integral  parts  of  the  comprehensive  design  model  to  be 
developed.  Only  by  considering  this  integration  can  a  truly  effective  and 
innovative  operating  environment  of  the  future  be  designed.  Human 
interactions  with  these  and  other  medical  technology  devices  are  also 
considered  as  integral  parts  of  larger  architectural  design  activities  which 
necessarily  consider  interactions  of  building  occupants  with  their 
surrounding  environments.  Modeling  at  this  level  will  also  include  the 
surgical  table,  monitoring  and  display  devices,  support  tables,  and  specific 
instruments  such  as  IV  poles  and  localized  controls.  This  comprehensive 
view  of  what  actually  constitutes  the  architectural  design  world  provides 
specific  requirements  for  the  VDE.  Ultimately,  this  comprehensive 
architectural  world  should  be  capable  of  being  coupled  with  simulation 
modeling  of  organs,  surgical  treatments,  etc. 

2.  At  the  level  of  the  room,  basic  characteristics  and  components  such  as 
entries/exits,  and  windows,  placement  of  surgical  level  equipment,  storage 
facilities,  and  seating  and  viewing  areas  will  be  evaluated.  Components  to 
be  studied  in  this  context  include:  environmental  apparatus  such  as 
climate  and  lighting  controls  and  communication  and  procedural  support 
systems. 

3.  At  the  level  of  the  building,  spatial  configurations  and  entry/exit 
patterns  in  relation  to  standard  hospital  layouts  will  be  analyzed  in 
conjunction  with  evaluation  of  room  level  linkages  to  larger  hospital 
environmental  and  medical  support  systems. 

Within  the  virtual  environment  created,  surgeons  and  other  medical 
personnel  will  be  able  to  enter  into  a  proposed  facility  via  virtual 
technologies.  Users  will  walk  around  in  the  virtual  space  —  literally  putting 
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themselves  in  front  of  a  virtual  operating  table  with  a  virtual  patient  on  it. 
The  user  will  be  able  to  look  at  equipment  locations,  lighting  environments, 
and  a  host  of  other  things  that  affect  the  quality  and  functionality  of  the  room 
from  the  viewpoint  of  the  user. 

In  the  subsequent  Phase  II  of  the  project,  human  movement  and  circulation 
(traffic  patterns)  as  well  as  more  sophisticated  use  issues  can  be  explored.  As 
noted  earlier,  the  project  will  ultimately  explore  the  use  of  teleoperated 
systems,  automatically  controlled  equipment,  and  other  advanced 
technologies  in  the  surgical  room  —  all  dynamic  systems  that  will  be  modeled 
and  operated  in  real  time  within  the  virtual  environment.  For  example, 
features  such  as  operating  tables  and  task-lighting  devices  may  have 
movement  capabilities  that  are  not  only  more  versatile  than  current  designs, 
but  responsive  to  control  via  biosensors,  voice  or  other  techniques.  The 
activation  and  movement  of  devices  of  this  type  would  be  simulated  within 
the  virtual  environment.  A  surgeon  would  thus  be  able  to  experience  how  a 
device  such  as  special  task-lighting  would  respond  to  requested  changes,  or 
how  such  a  device  would  automatically  adjust  to  changing  conditions  via 
sensory  inputs.  Design  improvements  would  follow  from  the  user  feedback 
received.The  room  design  to  be  developed  will  incorporate  and  apply 
exciting  new  technologies  now  under  development  for  meeting  military 
needs,  but  the  design  will  not  be  restricted  to  them.  The  design  constraints 
imposed  by  creating  a  surgical  environment  within  a  MEDFAST  vehicle,  for 
example,  absolutely  necessitate  the  kind  of  rigorous  design  thinking  that  will 
invaluably  inform  operating  room  environments  in  different  contexts, 
adaptable  to  MASH  units,  military  hospitals,  and  civilian  hospitals. 
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Review  of  Project  Activities  and  Conclusions; 


Despite  the  importance  and  the  great  promise  of  the  Virtual  Design 
Environment  for  a  Surgical  Room  of  the  Future  there  are  a  number  of 
formidable  technical  problems  that  will  inhibit  progress  of  the  project  unless 
they  are  resolved.  The  issues  can  be  divided  into  two  categories,  although 
many  others  can  be  conceived  in  a  future  study .  The  issues  are  very  complex 
and  are  tied  to  the  intricate  definition  of  the  architectural  design  process. 
However,  most  computer  technology  on  the  market  today  ,  hardware  and 
software,  are  not  compatible  or  flexible  with  the  way  architects  actually  design 
buildings.  The  predominance  of  computer  technology  was  designed  for  word 
and  numerical  processing  and  has  little  adaptability  for  the  kind  of  intuitive 
and  multi-modal  process  that  designers  employ.  A  typical  designer,  across  the 
course  of  a  conceptual  design  phase  of  a  project  (about  6-8  weeks  in  duration 
will  use  a  number  of  methods  that  include  a  vast  range  of  materials  like  pencil, 
ink,  clay,  wood,  metal,  plastics  of  various  sorts,  natural  materials,  lighting, 
photography  and  many  others  that  are  literally  impossible  to  catalog  due  to 
the  unpredictability  of  the  process.  All  the  methods  are  attempts  at 
*'simulating"the  actual  building  short  of  the  possibility  of  spatial  immersion 
in  the  actual  future  project  The  fact  of  matter,  today^  computer  technology 
can  not  simulate  any  of  these  methods,  except  rudimentary  mechanical 
drawing,  spatial  modeling  with  ever-increasing  color  rendering  capability. 
The  primary  issues  of  the  building  environment  are  many  years  away  from 
being  translated  into  computer  simulation  let  alone  3-D  immersive 
environments.  The  current  crop  of  products  that  are  marketed  as  "virtual 
reality"  interfaces  are  primarily  designed  for  game  and  entertainment 
applications  and  have  so  far,  based  on  this  study,  have  had  little  value  in 
designing  a  sophisticated  environment  like  a  surgical  room.  Their  capability 
is  limited  on  a  number  of  fronts  and  the  following  list  is  anattempt  to 
document  their  short-comings.  At  this  time,  it  would  not  be  appropriate  to 
list  the  actual  products  that  were  used  as  part  of  the  project  since  the  aim  of 
the  study  was  not  a  case  of  product  testing.  These  comments  are  a  generic 
reviewing  of  "cutting  edge"  technology  as  a  basic  research  tool  and  are 
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restricted  due  to  temporal  and  budgetary  constraints  of  the  project.  The 
systems  employed  included  all  the  components  of  hardware,  software, 
displays  and  assorted  peripherals  that  can  be  described  as  a  'Virtual  reality 
interface": 

1.  Visual  and  graphic  resolution  is  poor  to  fair  in  the  affordable  systems, 
whereas  the  better  high-end  systems  due  to  costs  and  proprietary  restraints  are 
inaccessible  to  the  profession  or  even  the  research  community.  None  of  the 
systems  have  resolution  properties  that  could  be  adaptable  to  sophisticated 
building  design.  "Cartoon-like"  qualities  limit  proper  identification  of 
environment  factors  like  materials,  lighting,  texture,  color  and  especially 
human  form 

2.  No  integration  of  material  and  physical  properties  with  graphic  software. 
Properties  like  air-flow,  lighting,  temperature  gradients 

3.  Head-mounted  displays  not  suited  to  design  work;  uncomfortable  to  wear 
for  long  periods  and  associated  symptoms  of  disorientation  like  dizziness  and 
nausea  emerge  after  long-term  application  (  more  than  an  1/2  hour) 

4.  Incompatibility  of  proprietary  software  across  computer  operating  systems 

5.  Haptic  and  tactile  interfaces,  key  to  interacting  with  environmental  factors 
prove  to  be  unsatisfactory  and  at  times  non-functional 

6.  Interfaces  for  fine  motor  skills  of  design  activity  non-existent  like  drawing, 
sculpting  and  various  shop  skills 

7.  Immersion  experience  of  3-D  "cave  environments"  highly  disorienting 
due  to  poor  physical  cues  for  equilibrium  and  stabilization 

8.  The  bandwidth  demands  of  distributed  simulation  environments  are 
beyond  the  capabilities  of  current  OTS  systems 

9.  All  VE  systems  require  a  range  of  technical  personnel  to  be  available  to  user 
due  to  chronic  and  regular  systems  problems 

10.  Current  CAD  databases  not  easily  or  at  all  adaptable  to  VE  systems 
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11.  Extensive  and  expensive  learning  curve  for  designer  user  community 


Conclusion; 

Extensive  research  and  development  on  virtual  environment  technology 
needs  to  occur  before  it  can  be  applied  as  an  architectural  design  tool.  This  is 
true  at  the  level  of  the  hardware  and  software.  An  extensive  program  needs 
to  be  developed  that  integrates  the  physical  properties  of  built  environments 
and  their  architectural  representation.  Some  of  this  work  is  even  at  the  basic 
science  research  level.  For  instance,  the  understanding  of  air  flow  dynamics 
and  how  to  represent  those  forces  visually  and  accurately  during  the  design 
process  is  a  basic  need  that,  at  this  stage,  fundamentally  does  not  exist  beyond 
a  very  rudimentary  level.  Room  temperature  ambience  and  how  it  effects  the 
occupants  in  the  room  over  the  course  of  a  day  is  not  translated  into  any 
software  package  that  is  available  let  alone  affordable.  A  full  immersion 
technology  platform  into  architectural  space  needs  to  be  explored  also  at  a  basic 
science  level.  At  this  point  immersion  with  current  off  the  shelf  technology  is 
a  very  limited  capability  with  problems  in  resolution,  equilibrium, 
interactivity,  motion  control  and  ergonomic  design.  This  is  a  major  research 
project  in  itself  and  can  not  be  simply  handled  with  current  off  the  shelf  tools. 

A  roadmap  to  develop  this  technology  for  design  applications  is  required  and 
should  be  the  next  phase  before  any  work  proceeds  on  the  actual  surgical 
room.  This  roadmap  should  include  an  industry-academic  team  that  can 
outline  more  precisely  what  are  the  technologies  available  and  how  can  they 
be  integrated  better,  and  then  what  would  be  the  areas  of  future  development. 

At  this  point  this  survey  is  vital  and  only  exists  in  fragments  throughout 
industry  and  the  academic  commimities.  A  6-month  effort  would  be  required 
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to  put  this  survey  together,  then  work  can  be  resumed  on  the  actual 
planning  of  the  sui^ical  room  of  the  future. 


Appendix  1:  Program  Team  and  Team  Management 

The  project  was  managed  by  the  Massachusetts  Institute  of  Technology  and 
will  sub-contract  to  the  Harvard  University  and  the  Massachusetts  General 
Hospital.  The  teams  will  be  headed  by  Principal  Investigators:  Dr.  Kenneth 
Kaplan,  MIT,  Nathaniel  Durlach  and  Ian  Hunter,  MIT,  Professor  Daniel 
Schodek,  Harvard,  and  Drs.  Steve  Dawson  and  David  Rattner  from  MGH. 

The  MIT/Harvard/MGH  team  consists  of  leading  designers,  engineers, 
scientists,  inventors,  surgeons,  and  others  with  a  shared  interest  and  expertise 
in  new  and  emerging  technologies  in  relation  to  the  development  of 
innovative  Virtual  design  environments.  A  goal  of  this  group  is  to  advance 
the  state  of  technologies  used  in  the  design  process,  while  simultaneously 
inventing,  testing,  and  developing  the  physical  manifestations  of  the  design 
in  relation  to  the  virtual  environments  they  develop.  The 
MIT/Harvard/MGH  team  will  amalgamate  many  previously  separated 
professions  into  a  synthesized  group  through  these  advanced  design  tools. 

Individuals  in  the  MIT/Harvard/MGH  team  bring  a  unique  combination  of 
skills  to  the  project,  each  contributing  to  the  needs  and  specificity  of  the 
operating  room.  The  combination  of  architects,  engineers,  scientists,  and 
surgeons  involved  in  the  creation  of  virtual  design  environments  is 
unprecedented  and  will  allow  for  close  collaboration  on  issues  such  as;  the 
development,  use  and  optimization  of  virtual  environment  technologies; 
programmatic  and  spatial  analysis;  advanced  building  technologies;  structural 
engineering;  materials  engineering;  rapid  prototyping;  and  other  fields. 
Building  on  these  disciplines,  members  also  have  the  capability  to  incorporate 
their  work  on  teleoperations,  micro-robotics  and  associated  electro-optical- 
mechanical  instrumentation  into  the  hospital  environments  of  the  future. 

Massachusetts  Institute  of  Technology 
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Department  of  Architecture 
Kenneth  L.  Kaplan 
Emily  M.  Tucker 

Massachusetts  Institute  of  Technology 
Department  of  Mechanical  Engineering 
Prof.  Ian  Hunter 
Dr.  Lynette  Jpnes 

Massachusetts  Institute  of  Technology 
Research  Laboratory  of  Electronics 
Prof.  Walter  A.  Aviles 
Nathaniel  I.  Durlach 

University  of  Auckland,  New  Zealand 
Department  of  Engineering  Sciences 
Prof.  Peter  Hunter 


Harvard  University 
Graduate  School  of  Design 

Prof.  Daniel  L.  Schodek 
Shana  Priwer 

Massachusetts  General  Hospital 
Dr.  Steve  Dawson 
Dr.  David  Rattner 

Foster  Miller,  Inc. 

Anthony  Aponick 

Independent  Consultants 

Dr.  Michael  L.  Bums,  President,  Science,  Math  &  Engineering,  Inc. 
Wade  Hokoda,  Computer  Graphics  Specialist 
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Appendix  2:  Problems  in  the  OR:  Twenty  Issues  for  Examination 

1.  General  Reporting  of  Medical  Accidents  and  Device  Failures 

2.  Accidents  relating  to  the  use  of  Lasers 

3.  Electrocautery  Accidents 

4.  Speculations  on  Causes  of  Medical  Accidents 

5.  Surgical  Accidents/Medical  Malpractice:  Case  Studies  and  Examples 

6.  Surgical  Accidents/Medical  Malpractice:  Analysis,  Statistical  Data,  and 

Commentary 

7.  Human  Misuse  of  Medical  Equipment:  Deliberate  and  Accidental 

8.  Unsafe  Medical  Equipment  and  Machinery 

9.  Fires  and  Electrical  Problems  in  the  Operating  Room 

10.  Pollutants  and  Environmental  Hazards  in  the  Surgical  Room 

11.  Hospitals  as  Spreaders  of  Infection 

12.  Surgical  Wound  Infection 

13.  Operating  Room  Monitor  Alarms 

14.  Deaths  by  Restraint 

15.  Monitoring 

16.  Serious  Problems  with  Surgical  Uniforms 

17.  Spread  of  disease  doctor-to-patient,  patient-to-doctor 

18.  Quality  control  issues 

19.  Standards 

20.  Miscellaneous 
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Appendix  3:  VDE  Specification  (Off  the  Shelf) 


•Hardware 

ONYX  Reality  Engine,  Silicon  Graphics 

-multi-channel  option  (output  images  to  4  different  devices) 

-64  megs  of  RAM 

-16  megs  of  texture  memory 

-4  to  8  processors  (the  more  the  better) 

-1  gigabyte  hard  disk 
-SOFTWARE: 

-"Developer's  Option" 

-"C"  &  "C++" 

-"Performer"  (low  level  graphics,  improves  performance  of  VR 

software) 

Kubota  Pacific  Computer 
-Santa  Clara,  CA 
-based  on  DECs  Alpha  chip 

•  Software 

WorldToolKit,  SenseS 

-1001  Bridgeway,  Suite  447,  Sausalito,  CA  94965 
-runs  on  both  the  SGI  and  the  Kuboda 
-simulation  manager 
-real-time  rendering  pipeline 
-object  manager 

-lighting,  animation  sequences,  input  sensors,  &  graphic  display 
devices 

-ability  to  work  with  stereoscopic  imaging  and  3D  sound  (alliance  with 
Crystal  River  Engineering,  Intel,  and  StereoGraphics. 
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-access  to  functions  that  control  low-level  geometries  for  constructing 
virtual  objects.  Greater  ability  to  control  which  tasks  are  executed  and  in  what 
order. 

-can  construct  virtual  objects  on-the-fly 

-"C"  based  programming 

-first  released  in  1991 

-current  version:  2.0 

-price:  $2,995 

-support  for  HMD 

-support  for  Polhemus  Isotrack2  and  Fastrack,  and  Ascention  Bird 
joystick 

-rendering  card:  Action  Media  750,  SPEA  Fire 

-scripting  code:  C++  function-based 

-runtime  license:  $350-$1000  based  on  quantity 

-user  group:  yes,  administered  by  NASA  Ames 

-installed:  licensed=1000+,  developers=300+  (as  of  June  1993) 

•Tracking 

Polhemus  "FASTRACK" 

-One  Hercules  Drive,  PO  Box  560,  Colchester,  VT  05446 
(802-655-3159  v,  802-655-1439  f) 

(800-655-3159  x  234) 

-six  degree  of  freedom 
-little  latency 

-uses  digital  signal  processing  (DSP)  to  accelerate  tracking  to  4ms 

-update  rate  of  120  Hz 

-operational  range  of  10  feet 

-large  company,  more  likely  to  donate  equipment 

-magnetic  position  sensor 

-latency  and  eddy  currents  a  problem  with  magnetic  trackers 

Ascention  Technology  "Flock  of  Birds" 

-Burlington,  VT 
-magnetic  position  sensor 

-latency  and  eddy  ciurents  a  problem  with  magnetic  trackers 
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•  Head-Mounted  Displays 


BOOM3C  (Binocular  Omni-Oriented  Monitor),  Fakespace 
-4085  Campbell  Ave.,  Menlo  Park,  CA  94025 
-$95K 

-mechanical  system 
-1260  X  980  resolution 
-full  color 

-two  monochrome  CRT  displays  with  synchronized  Tektronix  color 

filters 

-no  lag  or  tracking  delay 

HMSI  (Head  Mounted  Sensory  Interface),  RPI  Advanced  Technology  Group 
-PO  Box  14607,  San  Francisco,  CA  94114 
-$15K 

-3  1/2  ounces  (thick  sunglasses) 

-450  X  220  res.  (640  x  480  resolution  quoted  in  CGW  good  enough  for 
medical  simulation) 

-Field  of  View  65  to  110  degrees  (blurring  at  110  degrees) 

-real  world  peripheral  vision  without  eyecups 

-Duane  knows  president,  could  get  us  beta  of  high-res  version 

-will  soon  be  wireless  (according  to  Duane) 

VIM  (Vision  Immersion  Module),  Kaiser  Electro-Optics 
-2752  Loker  Ave.  W.,  Carlsbad,  CA  92008 
-$15K 

-visor-like  display  unit 
-4.3  lbs 

-F.o.V.  30  deg.  verticle,  100  deg.  horizontal 
-good  resolution 

-ability  to  tile  the  viewed  image  2, 3,  or  4  times  across  the  viewing  field 
(multiple  viewports) 

-big  company,  more  likely  to  donate  machinery 
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Appendix  4:  Interoperability  Studies  of  Current  Health  Care  Delivery  Systems 
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Appendix  5:  Viewgraphs 
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DESIGN  ENVIRONMENT  ISSUES 

•  Surgical  Area  •  Spatial  Design  •  Architectural/Engineering 

•  Room  Level  •  Environmental  Quality  •  Costs 

•  Building  Level  (Visual,  Lighting,  Thermal,  Etc.)  •  Facility  Management 

•  Complexes  •  Equipment  Design  &  Human  Interactions  Life-cycles 
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Advantages  of  a  Virtual  Reality  System 
for  Prototyping,  Evaluation,  and  Testing 


Prototyping 


•  ability  to  create  and  experience  different  ideas  and  possibilities  based  on  a  single 
constructed  model 

•  time  saving  by  virtue  of  possibility  of  "saving  experiences"  for  later  review  and 
adjustment  -  only  possible  currently  through  human  memory 

•  speed  with  which  multiple  options  can  be  initiated  and  explored 


Evaluation 


•  possibility  of  combining  and  splicing  ideas  in  virtual  environment  without  need  to 
physically  regenerate  composite  ideas 

•  possibility  to  review  and  evaluate  multiple  schemes  rapidly,  makes  changes,  and 
save  revised  versions 

•  inherent  flexiblity  of  virtual  prototype  in  its  ability  to  be  transformed  and 
manipulated  by  multiple  users  over  a  period  of  time 


Testing 


•  cost  saving  of  testing  ideas  and  schemes  in  virtual  world 

•  concept  of  shared  experience  in  virtual  space 

•  allowing  audience  to  experience  idea  or  schema  without  expending  the  time  or  money 
necessary  to  physically  build  individual  ideas 

5B 


57 


Traditional  modes  of  communication  for  designers 

Media  -  drafted  inked  drawings  -  generated  individually 

-  pencil  or  color  renderings  -  generated  individually 

-  3-dimensional  models  -generated  individually 


Interaction  -  meetings/presentations 

-  telephone  calls 

-  occasional  site  visits 


Future  modes  of  communication  for  designers 

Media  -  computer-aided  drawings  -  multiple  drawings  generated  from  one  model 

-  digitally-enhanced  images  -  generated  indivually 

-  4-  and  5-dimensional  models  -  infinite  variances  generated  from  model 

Interaction  -  combination  of  live  meetings  with  video  teleconferencing 

-  on-line  dialoguing  and  image  transference 

-  site  visits  with  animated  visualizations 
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Operating  Environment 
of  the  Future 


Northrop 


—System  Integration 
—System  Specification 
—Smart  Table 
—Hands-free  Command 
— Intuitive  Information  Mgmt. 
—Rapid  Prototyping 


Harvard 


—  System  Specification 

—  Virtual  Specification 

—  Virtual  Environments 

—  Architectural  Design 

—  Rapid  Prototyping 

—  MedicalConsulting(MGH) 

—  Medical  Testing  (MGH) 


Johnson  &  Johnson 


—  System  Specification 

—  Battle  Trauma  Simulator 

—  Line  of  Sight  Display 

—  Systems  Integration 

—  Medical  Testing 


Figure  6-1.  Operating  Environment  of  the  Future  Consortium 
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Advantages  of  the  Internet  as  a  Design  Tool 


tost  Efficiency 


Total  cost  of  most  Internet  applications  is  a  low  yearly  fee, 
with  the  possiblilty  of  local  phone  chages  for  non-university 
affiliates. 


Rapid  Communication  and  Exchange  of  Ideas 


The  rate  of  information  flow  over  the  Internet  depends  on 
factors  such  as  time  of  day,  number  of  users  on  the  system, 
and  system  maintenance,  but  lag  is  generally  not  more  than 
a  few  seconds. 


Direct  communication  versus  ’’posting" 


The  Internet  affords  the  possiblilty  of  realtime  on-line 
dialoguing,  as  well  as  "posting"  ideas,  or  leaving  messages, 
for  others  to  see  and  respond  to  at  their  leisure. 


Multiple-party  and  private  conferencing 


Unlike  any  standard  conference  call,  Internet  applications 
such  as  the  IRC  allow  for  multi-user  conference  calls  while 
simultaneously  offering  the  possiblility  for  private  "talking," 
all  in  the  same  conversation. 


possibility  of  multi-media  transference 


While  text  transference  is  currently  the  easist  and  fastest 
type  of  information  flow  over  the  Interent,  within  the  next 
several  years  there  will  be  options  available  to  tranmsit 
sounds  and  images  as  well,  both  for  display  and 
manipulation. 


Rapid  access  to  resources 


The  research  applications  of  the  Internet  are  one  of  its 
strongest  features;  convenient  access  to  library  and 
information  systems  the  world  over  is  readliy  available  and 
easilv  searchable. 

j 
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INFORMATION/DATA  REALIZATION 

A.  Regnet  -  high-speed  computing  network 


6? 


INTERFACES 

A.  Hardware 

B.  Software 


National/International  Level 
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